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ABSTRACT 

This  paper  Is  in  response  to  a  growing  concern  about  the  adequacy 
of  present  measures  and  methodologies  in  depicting  air-to-ground  delivery 
system  accuracy.  An  accuracy  measure,  measurement  methodology  and 
performance  guarantee  based  on  cost-effectiveness  techniques  are 
developed.  The  measure  Is  based  on  the  frequency  of  mission  success. 

The  methodology  Is  based  on  Bayesian  techniques  using  a  multinomial 
distribution  to  represent  the  radial  miss  distance  pattern.  A  technique 
for  using  an  estimate  of  CEP  to  determine  the  prior  parameters  Is 
developed.  Actual  and  simulated  impact  data  are  used  to  compare  the 
proposed  methodology  to  historically  accepted  and  other  recently  proposed 
techniques.  The  methods  of  cost-effectiveness  are  appliad  to  guaranteeing 
an  air-to-ground  system  in  an  effort  toward  making  costs  more  controllable. 
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I.  INTRODUCTION 


A.  PURPOSE 

The  Intent  of  this  thesis  is  threefold;  to  propose  a  measure  of 

I 

effectiveness;  to  propose  a  method  to  determine  the  specific  effective¬ 
ness;  and  to  propose  the  concept  of  a  cost-effectiveness  guarantee. 

All  three  are  proposed  Wtth‘respedt^o^an'^ir-»to“ground''(A/6)'^#eapons 
delivery  system  in  a  dive  maneuver.  However,  the  techniques  proposed, 
with  the  necessary  modifications,  appear  to  have  wider  applications. 

Some  of  the  development  is  incomplete  and  requires  further  investigation. 

B.  NEED  FOR  ACCURACY  MEASUREMENT 

Prior  to  developing  a  meuiod  for  measuring  the  accuracy  of  an  A/G 
delivery  system,  it  is  important  to  understand  the  need  for  accuracy 
measurement.  Several  heeds  are  discussed. 

1.  Specification  Compliance 

In  the  Test  and  Evaluation  (T&E)  community  a  determination  of 
specification  compliance  is  usually  the  prime  motive  for  measuring 
accuracy.  The  accuracy  measure  and  occasionally  methodology  are  speci¬ 
fied  in  the  applicable  contract  guarantees.  Confusion  can  be  introduced 
by  the  use  of  different  measurement  units  and  methodologies  in  different 
specifications. 

A  typical,  though  fictitious,  example  of  an  accuracy  specification 
is: 

"Exhibit  a  15  mil  circular  error  probableCCEP),  corrected  for 
aiming  error,  computed  in  the  plane  nonnal  to  the  line  of  sight 
from  the  release  point  when  delivering  Mk-76  practice  bombs 
at  a  release  airspeed  between  400  and  450  KIAS,  a  dive  angle 
between  40  and  50  degrees  and  a  release  slant  range  to  target 
less  than  10,000  feet." 

Testing  to  this  specification  would  probably  be  expensive 


Also  inherent  in  the  specification  example  is  the  singular  usage 
of  the  measure  of  accuracy.  This  leasure  in  itself  has  little  value 
outside  of  the  specification  context.  Therefore,  it  appears  that  a 
significant  amount  of  money  and  time  would  be  expended  with  negligible 
information  gain  beyond  specification  compliance. 

2,  Sortie  Predictions 

In  the.^employment  of  an  A/G  system  there  is  a  need  for  a  differ¬ 
ent  measure  of  accuracy.  Strike  planners  and  weaponeers  need  to  estimate 
the  probability  of  a  weapon  impacting  within  a  given  distance  of  a  target. 
(The  methodology  used  for  this  purpose  is  described  later.)  This  is  an 
important  need  as  it  is  required  throughout  the  lifetime  of  the  systan. 

3.  System  Cemparisons 

Often  a  need  arises  to  compare  a  system  with  some  other  system 
or  systems.  One  of  the  measures  of  effectiveness  that  should  be  used  for 
comparison  is  accuracy.  Thus,  a  need  arises  for  a  measure  of  accuracy, 
common  to  the  various  systems  being  compared.  An  identical  need  exists 
if  a  cost-effectiveness  analysis  is  to  be  conducted. 

Three  general  requirements  for  measurement  of  accuracy  have  been 
discussed.  As  presented,  each  of  these  requirements  uses  a  different 
measure  and  the  measures  need  not  be  compatibly  defined.  In  theory,  it 
could  occur  that  several  separate  determinations  of  accuracy  would  be 
required  for  a  single  system.  In  practice,  this  is  not  usual,  however, 
a  common  technique  would  be  beneficial  so  that  all  requirements  could 
use  the  same  measure. 

C,  HISTORICAL  MEASUREMENT  METHODS 

Historically  the  measurement  of  accuracy  of  nearly  all  types  of 
weapons  delivery  systems  has  involved  probability  distributions  and  the 
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parameters  that  define  these  distrifsitlons.  Seve?al  tefas  tiat 
coRinonly  used  In  weapons  accuracy  arailysis  are  shown  is  Flpirs  1. 

1.  Distributions 

The  normal  family  of  probability  dis^botiocs  bssa 

accepted  as  the  proper  family  for  the  distribatii^  of  iapacts- 

Recently  this  concept  has  coe^  under  closer  scmtiigr.  it 
suggested  tiiat  a  normal  distribution  way  not  always  accurately 
a  parent  distribution  cf  impacts  and  other  f^lies  s  tis  Casc^ 
have  been  prv^osed  [11. 

a.  Normal  and  Variations 

Many  different  variations  of  the  isnsal  distribatiDS 
been  used  or  proposed  but  only  the  two  most  comes  are  distassed. 

(1 )  Bivariate  Horsal.  The  bivaria^  soraai  is  the  asrs 
flexible  of  the  two  variations  discuss«i»  perrnittlsg  the  errars  is 
and  deflection  to  be  correlated.  Lettir^  x  denote  ran^  y  deiEJle 
deflection,  the  density  function  is; 


(1)  f(x.y.)  = 


- 1 — g-exp{  ^ 

2TOxCy{l^  )  2{l-p  )  G. 


X-s  , 

£(— 


Often  the  range  and  deflection  errors  ere  assist  to  be 
lated  so  that  p  is  approximately  zero,  A  nstatic©  of  t^ 
system  can  also  be  used  to  eliminate  ti«  correlatioi}  hut  tte 
variables  do  not  represent  true  ran^  and  deflation  errors.  Ihe 
uncorr^lated  density  reduces  to: 

(2)  f(x^)  =  i  ^  ]  5 

X  y  X  y 
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Rcnge  Error  (x) 


Aircraft  Flight 
Path 


Figure  I. 

Depiction  in  the  Ground  Plane  of  terms 
commonly  used  in  Weapons  Accuracy 
Analysis. 


The  parameters  are: 

]iy^  -  mean  of  the  range  error  distribution 

Py  -  mean  of  the  deflectio.'  error  distribution 
2 

-  variance  of  the  range  error  distribution 

2 

a  -  variance  of  the  deflection  error  distribution 
p  -  correlation  between  the  »*ange  and  deflection  errors 

^tandard-.s^tlsticaKtechnlques  .cari.be.>iised  .to.estimate  these  parameters 
from  observed  data. 

(2)  Circular  Nornu\l.  The  more  commonly  used  normal  distri¬ 
bution  is  the  circular  nomal  in  which  It  is  assumed  t..*at  the  range  and 
deflection  errors  are  inde|.endent  (uncorrelated),  have  mean  zero  and 
have  common  variance.  The  circular  normal  cunulative  function  where  r 
Is  the  radial  miss  distance  is; 

r2 

(3)  F(r)  =  1  -  exp  {-  .  j  r  >  0 

2a^ 

Procedures  have  been  developed  for  use  when  a  f  a 

A  jr 

[2,  p.  3  and  4];  i.e.,  the  distribution  Is  an  elliptical  normal. 

An  axis  rotation  can  be  used  tf  eliminate  the  correlation  between  range 
and  deflection. 

2 

An  estimator  for  the  c  parameter  Is; 

N  2 
E  r/ 

’2  _  1=1  ■ 
a  =  - 

2N 

The  circular  normal  has  computational  simplicity  over 
the  more  general  bivariate  normal  distribution,  but  the  assun^tions  are 
quite  restrictive. 
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b.  Cauchy 

An  Air  Force  report  £1]  of  an  analysis  of  coinbat  Impacts 
observed  In  Southeast  Asia  found  that  the  normal  family  did  not  yield  a 
good  distributional  fit  of  the  data.  One  of  the  distributions  that  was 
shown  to  closely  approximate  the  data  was  the  Caucf\/. 

The  functional  forms  of  the  Cauchy  were  proposed; 

(4)  Rectangular  Cauchy  F{x^)  =  ^  tan*^  tan**^ 

2 

(5)  Circular  Cauchy  F(r)  =  —  tan“^  {  — x- 

^  +  r^ 

The  estimator  for  the  parameter  B  was  proposed  as: 

A 

B  =  .455  •  (radial  miss  distance  of  the  median  Impact) 

The  functional  forms  of  the  Cauchy  pri^sed  have  the 
advantage  of  simplicity  but  lack  mean  values. 

c.  Direct  Hits  Plus  Distribution 

The  Air  Forc«J  study  [1.1  pointed  out  that  several  isaacts 
were  observed  to  be  directly  on  target  contrary  to  the  predictions  of 
a  continuous  distribution  function.  This  may  be  explained  by  considering 
the  method  of  measuring  the  miss  distances  (photographic),  tJie  physical 
size  of  the  target  and  souk  ego  oriented,  psychological  attraction  of 
the  target  itself.  The  nethod  proposed  to  account  for  the  positive 
mass  at  the  target  was  to  introduce  a  proportion  of  direct  nits.  The 
distribution  function  then  becomes: 

(6)  S(x,y)  =  6  +  (l-s)  F(x,y)  In  the  bivariate  case,. or 

(7)  G(r)  =  0  +  (1-6)  F(r)  in  the  circular  case. 

The  parameter  6  could  be  estimated  from  prior  experience  or 
could  possibly  be  some  universal  constant  derived  from  many  different 
systens. 
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d.  Other  Distributions 

Literally  hundreds  of  different  distributions  such  as  the 
Weibul,  exponential  or  uniform  or  variations  of  distributions  such  as 
a  mixture  of  two  circular  normals  or  a  localized  normal  have  been 
proposed.  Two  interesting  facts  emerge  from  these  proposals.  First, 
as  the  predictive  ability  of  the  distributions  Increases,  the  complexity 
.of  .the .functional  form^enerally  increases.  This  usually  Increases 
manipulation  difficulty.  Secondly,  nearly  all  of  the  distributions  or 
variations  proposed  are  continuous. 

2.  Measures 

There  are  several  commonly  accepted  measures  of  accuracy  tdiich 
are  functionally  related  to  the  parameters  defining  a  unique  distribution 
In  an  assianed  family  of  intact  distributions.  These  measures  are 
graphically  portrayed  in  Figure  2. 
a.  CEP 

The  circular  error  probable  is  defined  as  the  radius  o*.  a 
circle  centered  at  tiie  target  {or  designated  point)  ahidt  contains 
50  percent  of  the  obser*’^ed  independent  inpacts,  cr,  the  radial  distance 
to  the  median  inpact  [4,  p.  i-l,  1*23  The  functional  relationship  of 
CEP  to  the  distribution  parameters  is  found  from  the  following  integral: 
CEP 

(8)  F{CEP)  =  /  f(r)  dr  =  .5 

0 

As  an  example,  the  CEP  using  the  circular  nomal  distribution  1-  derived 


as: 


Fiaure  2. 

Depiction  of  Accuracy  Measures  in 
the  Ground  Plane. 

#  Individual  impact  points 
(  7  randomly  placed) 


.5  -  1  -  exp  («  =  exp  (- 

2a  2o^ 

16 


ln(2)  = 


CEP" 


2o" 


CEP  =  a\]l  ln(2)‘  =  1.1774o 


b.  REP/DEP 

The  range  error  prabable  and  deflection  error  probable  are 
slailar  t*;  CEP.  The  1^  is  the  distance  from  the  target  (or  some  desig¬ 
nated  point)  to  tha  median  impact  In  range  [4,p.  l-2,1-3].  The  functional 
relationship  of  REI'  to  the  distributional  parameters  is: 

REP 

(9)  F(REP)  -  F(-RE’)  =  .5  =  /  f{x)  dx  where  f(x)  is  the 

margin.!!  distribulic:i  of  x  from  f(x,y) 

dEP  Is  defined  similarly.  For  a  bivariate  normal  distribution, 

REP  =  .674c  and  DEP  =  .674o  . 

^  J 

It  should  be  noted  that  if  an  axis  rotation  was  used  to 
uncorrelate  the  range  errors  and  deflection  errors,  the  functional  form 
In  equation  (9)  is  no  longer  valid.  This  is  a  serious  disadvantage  of 
mathematically  uncorrelating  the  data. 

c.  fffiE 

The  mean  radial  error  is  defined  as  the  mean  of  the  radial 
miss  distance  distribution.  It  is  derived  below  for  the  circular  normal 
distribution: 

r  r^ 

fCr)  =  exp  { - 2*  } 

a  2a 

•  ^2  ,.2 

MRE  =  E[r3  —  /  exp  {-  — g- }  dr 

0  o*  2o^ 


this  Integral  Is  solved  [5,p.  458]  as 

E£r]  =  ^0  =  1.2530  =  MRE 

Of  the  listed  measures,  the  MRE  Is  probably  the  least  . 
frequently  used. 

d.  MPI 

The  mean  point  of  Impact  Is  the  point  which  has  as  Its  range 
and  deflection  coordinates  the  arltfmietic  means  of  the  range  and 
deflection  coordinates  of  the  Individual  Impact  points  [4,  p.  1-3]. 

The  MPI  Is  calculated  from  an  observed  sample  of  Impacts  rather  tiian 
a  hypothetical  distribution.  In  many  analyses  Csuch  as  T&E)  [Refs.  18, 
20,23,  and  24],  the  MPI  Is  used  as  the  center  of  the  observed  Impact 
distribution  Instead  of  the  target.  The  offset  of  the  WI  from  the  target 
Is  termed  a  system  bias  and  the  CEP,  REP,  DEP  and  MRE  are  calculated  with 
respect  to  the  MPI.  Obviously,  this  technique  would  not  be  useful  In 
weaponeerl ng  appl 1 ca t1 ons . 

Analogous  to  the  MPI  are  tlie  mean  poinc  of  Impact  lis  ratiy’ 
and  deflection  (MPIR,  MPID)  which  are  the  arithmetic  means  of  the  Impacts 
In  range  and  deflection, 

e.  Other 

Three  other  definitions  given  In  the  Joint  Munitions  Effective¬ 
ness  Manual  CJI€M)  [4,  p.  1-1 ,1-2]  are  of  Interest  and  are  quoted. 

(1)  "Bombing  Error.  The  combination  of  all  errors  which 
cause  weapons  to  miss  the  target.  Included  are  ballistic,  aiming,  release 
and  aircraft  system  errors," 

(2)  "Ballistic  Dispersion.  The  variation  of  the  path  of  a 
weapon  which  Is  attributed  to  physical  tolerances  In  the  weapon  dimensions 
and  aerodynamic  stability." 
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(3)  "Delivery  Accuracy.  The  measure  of  the  ability  of 
pilots^  to  put  the  weapon  impact  pattern  center  (usually  KPI)  on  the 
target  or  ain^oint.  The  unit  of  measure  of  the' variation  in  placanent 
of  the  pattern  center  may  be  a,  CEP,  or  REP  and  DEP.  It  is  these  measures 
that  are  used  in  predicting  the  results  of  future  weapon  releases  of  the 
same  type.  Delivery  accuracy  is  based  on  the  errors  in  aiming,  release 
and  aircraft  systems.  In  does  not  include  ballistic  errors." 

3-  Mils 

In  many  applications  the  accuracy  measures  are  expressed  in  mils 
(milliradians)  perpendicular  to  the  line  of  sight  (LOS)  at  release  or 
some  other  appropriate  point  along  the  aircraft  flight  path.  The  geometry 
involved  in  the  computation  of  the  mil  is  presented  in  Figure  3.  A  mil 
is  usually  defined  as  the  angle  subtended  by  a  secant  line  of  one  foot 
length  at  radius  of  moo  feet  [4,  p.  4-2].  The  'Reflection  mil  error  (d^^^) 
is  related  to  the  deflection  foot  error  (d^)  below  using  the  symbology 
of  Figure  3; 


(11)  d„  = 


1000  i. 


Due  to  the  geometry,  the  deflection  error  in  the  ground  plane  is  identical 
to  the  deflection  error  in  the  scoring  plane,  thus  no  correction  is 
required.  The  range  mil  error  is  computed  by  the  following  equations: 


1000  r. 


vrtiere  r  can  be  closely  approximated 


(especially  if  s/r^  is  large)  by 


(13)  r^  =  r^  cos 


It  seans  to  this  author  that  more  is  involved  than  just  Uie  ability 
of  the  pilot. 


Aircraft  at  release  or  some  other  designated  point 


Figure  3. 


Geometry  of  the  Mil  Definition 

B  =  Depression  of  the  Los  from  the 
horizontal. 

S=  Slant  range  to  the  target  in  feet 

=  Range  miss  distance  in  the  ground 
plane  in  feet 

=  Range  miss  distance  in  the  scoring 
plane  in  feet 

Mil  error. 


Hieoretlcally,  the  use  of  mils  transforms  Impact  data  taken 
from  various  release  slant  ranges  and  dive  angles  to  a  conmon  base. 
Traditionally,  separate  accuracy  measures  are  specified  for  each  given 
set  of  release  conditions;  I.e.,  slant  range,  flight  path  angle,  airspeed 
and  maneuver.  The  use  of  mils  permits  some  aggregation  of  accuracy  data 
.over  release  conditions. 

-D.  -‘PROBtEM 

From  the  material  thus  far  presented  It  Is  concluded  that  a  single, 
general  accuracy  measure  and  methodology  could  be  advantageous.  Some  of 
the  more  Inqrartant  attributes  of  a  good  measure  and  methodology  are: 

a.  suitability  to  each  need  for  the  measuranent  of  accuracy. 

b.  exactness^  of  the  estimation  methodology. 

c.  minimal  amount  of  testing  required  to  achieve  the  desired 
estimation  exactnciss. 

d.  freedom  fnwi  distributional  and  other  assumptions  restricting 
the  applicability. 

e.  Independence  fr«a  delivery  couditlons. 

f.  mathematical  tractablllty  and  computational  simplicity 
1}  for  data  analysis. 

2)  for  weaponeering. 

3)  for  maintenance  of  capability  records. 

g.  adaptibillty  to  new  systems. 

Even  the  few  attributes  listed  above  Indicate  the  difficulty  of 
deriving  an  "optimal"  measure  and  measurement  methodology.  Additionally, 

^Exactness  Is  defined  as  the  minimum  error  throughout  this  thesis. 


the  preferential  ordering  assigned  the  attributes  by  an  individual  will 
significantly  influence  his  judgement  of  the  "goodness”  of  a  particular 
nethod. 

By  carefully  defining  the  problem  and  attenpting  to  give  preference 
to  all  phases  of  the  problem,  a  methodology  has  been  developed.  This  is 
not  proposed  as  the  "optimal"  method  but  it  does  have  more  of  the  attri¬ 
butes  listed  above  than  previous  methodologies  known  to  this  author. 


II.  ACCURACY  MEASURE 


Prior  to  developing  a  methodology  for  determining  accuracy*  a  specific- 
measure  of  accuracy  should  be  determined. 

A.  SYSTEM  FUNCTION 

The  JMEM  definition  of  delivery  accuracy  (quoted  earlier)  can  be 
paraphrased  as  the  placement  of  an  impact  pattern  center  on  a  designated 
point.  The  measure  of  accuracy  being  some  description  of  the  precision 
of  that  placement.  However,  accuracy  of  an  A/G  delivery  system  may  also 
be  thought  of  as  the  frequency  with  which  a  system  performs  its  assigned 
function  or  functions.  This  definition  differs  from  the  JMEM  in  that  it 
does  not  include  assumptions  about  an  impact  pattern. (it  is  distribution 
free)  and  it  gives  the  accuracy  measure  in  terms  of  the  mission.  An  A/G 
delivery  system  has  the  singular  function  or  mission  in  a  combat  role  of 
target  destruction. 

Two  Important  results  can  now  bo  discerned.  First,  the  singular 
function  of  target  destruction  greatly  simplifies  the  development  that 
follows.  Second,  a  basis  for  the  proposed  definition  of  delivery  accuracy 
has  been  reached.  This  basis  can  be  built  upon  to  derive  a  measure  and 
methodology  that  are  related  directly  to  the  system  mission. 

B.  hCASURE  OF  EFFECTIVENESS 

Based  on  a  mission  of  target  destruction,  the  accuracy  measure 
definition  is  the  frequency  with  which  target  destruction  is  achieved. 

An  interpretation  of  the  frequency  could  be  the  nuirdier  of  targets  destroyed 
per  sortie.  Note  that  this  is  the  inverse  of  a  common  weaponeering 
measure,  the  number  of  sorties  required  to  destroy  a  target.  The  averaging 
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over  sorties  Is  not  essential .  It  could  have  been  taken  over  weapons 
expended,  attacks  or  other  quantities.  Sorties  was  chosen  because  It 
Is  consnonly  used  as  a  normalizing  quantity  In  aviation  terminology. 

it  may  seem  that  the  number  of  targets  destroyed  per  sortie  Is  more 
a  measure  of  effectiveness  (MOE)  than  an  accuracy  measure.  In  many 
■  contexts,  the  MOE  may  be  a  function  an  accuracy  measure.  For  brevity, 
the  term  MOE  will  be  used  and  should  be  Interpreted  as  meaning  both 
accuracy  measure  and  measure  of  effectiveness. 

The  MOE  chosen  (targets  destroyed  per  sortie)  closely  resembles  that 
i'sed  by  the  Weapon  System  Effectiveness  Industry  Advisory  Comnittee 
(WSEIAC)  [6,  p.  24,25]  which  presents  some  recent  analyses  of  related 
problems. 


C.  WEAPONEERING  EQUATION 

The  MOE  chosen  can  be  mathematically  expressed  by  a  probability 
statement;  the  probability  that  the  target  Is  destroyed  In  a  certain 
number  of  sorties.  This  Is  syntfjollzed  In  the  familiar  concept  of  the 
probability  of  failure  equals  the  product  nf  the  probabilities  of  failui*e 
on  each  of  several  assumed  independent  trails  as; 


(14) 


=  1  -  (1  -  p)”*"  where; 

a  Is  the  probability  that  vhe  target  is  destroyed, 
p  Is  the  probability  of  target  destruction  In  a  single  attack, 
n  Is  the  number  of  sorties 
t  Is  the  number  of  attacks  per  sortie. 

Solving  for  the  rate  of  target  destruction  per  sortie  O/n)  yields: 
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OS)  l/n  . 

Equation  (15)  will  be  called  tlie  %^)Qneenag  egsitloaf*. 

For.  convenience  In  tills  diesis,  the  naber  ef  attacks  per  scftie 
will  be  assuaed  to  be  unity.  In  wasy  af^licatisos,  sack  » 
heavily  defended  targets,  £  Is  tailty  by  polity.  IDawever,  ae  lass  af 
generality’  or  ciatheaatital  imsnslstssies  are  tnpssei  dtae  to  z 

to  be  unity. 

Superficially,  the  probdiility  of  tsi^t  destructiaa  is  a  s^le 
attack  (p)  Bay  appear  to  be  ideitical  to  tie  iiist^cal  aesiae 
accuracy.  A  closer  exaeinatiiwi  shous  p  to  be  aote.  AJkgroaty,  ^ 
depoids  on  the  ^tructfve  radiis  of  the  we^c^ts;^  eariHwtfon  ^  1- 

1C 

Hofiever,  die  results  of  the  KSEIAC  aaalysis  |7,g>.  S£-33|  §lve  a  Jeneii 
Insight  into  o.  The  U^IFX  r^rt  concai^^  that  p  stenit  be  to 

the  availability,  d^ieiMability  and  (Ability  of  the  systae  !ty  tke 
following  ei^tion. 

(16)  p  =  A^DC  idiere 

A^  Is  tt»  traispt^  of  the  sector  of  ^tbaifilit^  ^ 
systas  Is  in  sane  state  tie  start  ^  Ike 

0  is  tie  isatrix  of  pr^abilities  that  the  ^  is 

soae  state  at  tie  r^alrra  asi^on  t^ae  cs^itatnefl  on 
the  state  of  the  systss  «t  t^  start  ^  de  Assisi). 

C  Is  the  i^tor  of  caii^llities  coi^tlore^  on  de  tys^aa 
state. 

Appendix  C  gives  an  example  of  the  ^  of  tie  eiMnce 

imderstandli^  of  this  isportast  co^ipt. 

How  It  can  be  seen  that  C,  tie  capabilities,  are  adm  weie  canaority 
referred  to  hlstoritally  as  the  of  Jta  Isioftea 

distinctice  exists  ti^^  that  regies  teKst^etaun. 


D.  CAPABlLmr 

As  defined,  tie  capability  Is  related  to  and  conditioned  on  the 
systea  state.  No  nentlon  Is  made  concerning  the  delivery  conditions. 

This  Is  a  radical  departure  from  tee  historical  method  of  tying  the 
accuracy  to  a  specific  set  of  delivery  conditions.  In  theory  and  in 
r^llty,  the  probability  of  placing  a  weapon  within  a  given  distance  of 
the  target  is  dependent  on  the  delivery  conditions.  However;  the 
experl^ced  attack  aviator  rdio  has  flown  In  combat  or  attempted  to 
achieve  a  specified  set  of  delivery  conditions  over  an  unfamiliar  target 
and  terrain  on  the  first  attack  will  readily  admit  the  difficulty 
Involved.  The  presence  of  enemy  defenses  affects  all  delivery  parameters 
and  can  cause  large  deviations  from  programmed  dive  angle,  airspeed, 
rel^e  altitude^  and  run-in  heading.  Cloud  conditions  different  from 
those  predicted  may  dictate  last  minute  changes  In  dive  angle,  release 
altitutk  and  run-in  heading.  Hinds  not  anticipated  can  cause  dive  angle 
and  run-in  heading  to  change  during  the  attack.  In  close  fornmtion  attacks 
each  aircraft  usually  achieves  a  different  set  of  delivery  conditions. 

In  older,  manual  delivery  systems,  the  sight  setting  used  was  based  on 
a  precise  set  of  delivery  conditions.  Thus,  a  great  Importance  was 
Imposed  on  tee  achlevanent  of  these  prescribed  conditions.  Now,  sophis¬ 
ticated  systems  continually  compute  the  predlcteo  weapon  Impact  point 
artd  automatically  release  the  weapon  when  some  designated  point  coincides 
trite  tee  predicted  Inpact  point.  The  pilot  using  this  system  Is  free  to 
vary  his  delivery  conditions  “within  reason"  as  he  deems  appropriate. 

^Dlve  angle  and  release  altitude  define  the  slant  range  to  the 
target  which  is  an  Influential  parameter  In  the  accuracy. 


It  seons  reasonable  to  Insist  that  the  capability  measure  also  be 
free  of  delivery  conditions. 

The  "within  reason"  phrase  cited  above  gives  qualitative  bounds 
the  delivery  conditions.  These  bounds  should  reflect  the  current 
operational  tactics,  and  can  be  expected  to  change  with  time.  For 
.example.  In  the  "Vietnam  Era,"  the  bounds  might  have  been: 

.a.  ^Qiveu.aogle  ^25  .to  .6C  degrees 

b.  Release  altitude  4000  to  7000  feet 

c.  Airspeed  400  to  600  KIAS 

d.  Run*1n  heading  0  to  360  degrees 
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III.  ACCURACY  ESTIMATION  METHODOLOGY 


The  proposed  NOE  requires  the  estimation  of  p  =  A'DC.  The  estimation 
of  availability  and  dependability  (A  and  D)  has  been  well  documented  In 
numerous  reports  Including  the  HSEIAC  [7].  A  method  of  estimating 
capability  (C),  as  used  to  estimate  p»  Is  developed  herein. 

A.  DERIVATION 

The  detailed  derivation  Is  presented  In  Appendix  A.  The  derivation 
of  the  estimator  for  C  follows  a  Bayesian  approach.  The  techniques  of 
the  Bayesian  approach  are  explained  by  DeSroot  [8],  Savage,  Ralffa, 
Schlalfer  and  many  others.  The  derivation  Is  summarized  below  to  provide 
continuity. 

A  squared  error  loss  function  was  derived  as: 

(17)  L  =  - - - K-  Cln(l-p)-ln(l-p)]^  where  p  Is  the  estimator  of  p. 

(ln(l-a))2 

The  Bayes  estimator^  was  found  to  be: 

(18)  D*  =  E[ln(l-p)]  (the  symbol  ”  -  "  indicates  a  Bayes  estimator) 

Members  of  the  multinomial  family  of  distributions  were  chosen  as 
the  sampling  distributions  because  they  can  be  used  to  approximate  any 
distributional  shape.  The  probability  mass  function  of  the  multinomial 


(19)  ftx, . -  p,*1  •••  p^*k 

X,!  •••  x^! 


'a  Bayes  estimator  Is  the  one  which  minimizes  the  expected  loss. 
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Using  the  conjugate  family,  the  parameters  of  the  posterior  Dirichlet 
distribution  of  the  p^  are  +  Xp..., 

With  an  assun^tion  and  an  approximation,  the  Bayes  estimator  for  C  was 
found  to  he 

’  m  +  X.  k 

(21)  C*  =  I  — ^ - -  where  =  z  {o.  +  x.)  ,  and  m  is  the 

i=l  “o  .  ®  i=l  ^  ’ 

smallest  integer  greater  than  or  equal  to 
r^/interval  length  of  the  multinomial 
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It  ¥ds  found  that  the  prior  parameters  could  be  assigned  by  assuming  a 
prior  value  for  CEP  and  making  some  assumptions. 

^pendlces  B,  C  and  D  delineate  the  proposed  procedure  using  an 
exaiq}1e  problem. 


B.  ASSUMPTIONS 

Several  assun^tlons  are  made  In  the  measure  and  measurement  methodology 
derivation .  -This  ‘section* Wfl  1  *present^'Coraplete  listing-  of  -al  1  -the 
assumptions  and  corresponding  justifications. 

1.  Independent  Trials 

Independent  trials  were  assumed  in  the  weaponeeiing  equation 
(section  II  .C).  In  testing,  the  Independence  can  be  achieved  by  using 
only  the  first  weapon  dropped  In  a  series  or  by  randomization  of  the 
delivery  maneuvers  and  parameters  so  that  no  two  consecutive  deliveries 
are  the  same,  for  prediction,  the  Independence  assimiption  Is  conservative 
as  it  neglects  the  possibility  of  multipass  Improvement. 

2.  Accuracy  Definition 

The  "frequency  with  which  a  system  performs  Its  assigned  function(s)" 
definition  Is  one  of  many  possible  definitions.  The  rationale  behind 
the  particular  choice  was  the  direct  link  to  the  mission  as  discussed  In 
section  II. A. 

3.  Accuracy  Measure 

The  "rate  of  target  destruction  per  sortie"  Is,  again,  one  of  many 
possible  choices.  The  rationale  was  discussed  In  section  II. B. 

4.  Single  Attack  per  Sortie 

The  assumption  that  t  =  1  was  made  for  convenience  and  has  no 
effect  other  than  slii^l If  1 cation.  Any  value  may  be  assigned  to  i  without 
changing  the  derivation. 
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5.  Independence  from  Delivery  Conditions 

The  specific  assun^tions  and  an  extensive  discussion  of  the 
rationale  was  presented  in  section  II. 0. 

6.  Squared  Error  Loss  Function 

The  rationale  behind  the  choice  of  the  quadratic  loss  function 
was  the  generality  and  tractlblllty  of  that  form.  The  li^^llclt  assianptlon 
of  the  loss  being  equal  for  overestimates  and  underestimates  Is  a  simplifi¬ 
cation.  If  separate  treatment  Is  prefened,  the  methodology  Is  still 
correct  as  shown  In  Ref.  17,  p.  195-197. 

7.  Ftadlal  Miss  Distance 

The  radial  errors  were  analyzed  vice  separate  treatment  of  the 
range  and  deflection  errors.  The  rationale  being  that  any  emphasis  placed 
on  a  particular  heading,  or  more  Importantly,  heading  relative  to  some 
target  axis  may  lead  to  erroneous  conclusions.  Ideally,  use  of  the  proper 
run-in  heading  can  increase  the  accuracy  but  due  to  the  reasons  cited  In 
section  II. E,  this  will  often  result  In  an  overestimate  of  the  true 
accuracy. 

The  radial  measure  Is  expressed  In  the  ground  plane.  The  advan¬ 
tages  of  using  mils  in  the  scoring  plane  are  obvious,  especially  in  view 
of  the  varied  release  conditions.  Unfortunately,  targets  are  usually 
found  in  the  ground  plane  and  most  weapons  detonate  on  Impact  with  the 
ground.  The  geometry  of  the  problen  will  also  show  that  weapons  designed 
to  detonate  at  a  fixed  altitude  yield  to  a  miss  distance  measured  in  a 
ground  plane  projected  horizontally  up  to  the  burst  height. 

8.  Perfect  .Reliability 

The  assumption  that  A^D  =  1  was  made  for  simplicity.  Assuming 
otherwise  compl  .cates  the  mathematics  but  does  not  alter  the  concept. 


9.  CEP  as  Assigned  Prior 

Assigning  a  CEP  Is  one  of  several  methods  of  assigning  the  o^*s 
required  In  the  prior  distribution.  The  rationale  for  choosing  CEP  Is 
given  In  Appendix  A  but  other  schemes  might  suffice. 

10.  Uniform  Distribution  of  Pi 

The  justification  for  setting  all  the  E[pp  equal,  up  to  tte  CEP, 

Is  based  on  the  resulting  mathematical  simplicity.  Other  assignments 
might  be  acceptable  but  might  also  add  to  the  difficulty  of  analysis. 

11.  Each  PI  Distributed  Symmetrically 

Assuming  each  p.  Is  distributed  symmetrically  about  its  expected 
value  Is  another  simplifying  step.  Assignment  of  specific  values  to 
V£Pj]  Is  possible  for  i=1,...,j  but  adds  another  subjective  decision  to 
the  analysis. 

Deletion  of  assumptions  4  and  6  through  11  does  not  affect  the 
methodology.  The  mathematics  become  more  cumbersome  and  the  estimator, 

D*,  may  differ,  but  the  concept  ranalns  unchanged. 

Assun^tions  9  through  11  simplify  the  determination  of  the  a^'s  and 
as  will  be  shown  in  the  numerical  analysis  (section  IV),  yield  good 
results.  However,  changing  these  assumptions  does  not  alter  the  estimator. 

C.  APPLICABILITY 

Both  the  accuracy  measure  and  methodology  have  been  derived.  It  is 
worthwhile  now  to  refle';t  back  to  the  listed  attributes  (section  I.D) 
and  comment  on  the  compliance  with  them. 

1 .  Suitability  to  Needs 

The  three  needs  cited  were  specification  compliance,  weaponeering, 
and  system  conparison.  The  suitability  of  the  selected  MOE  to  the  latter 
two  needs  is  apparent.  The  weaponeering  measure  was  used  as  the  HOE  and 
an  MOE  is  one  of  the  essential  elements  of  system  comparison. 


30 


The  sut10111ty  to  specification  compliance  Is  not  obvious  and 
In  view  of  present  specifications  Is  even  dubious.  In  section  V  It  will 
be  shewn  that  specifications  can  be  couched  In  terms  of  cost<-effect1veness 
with  many  attendant  advantages.  The  suitability  should  becofiie  apparent 
In  that  context. 

2.  Exactness 

The  methodol oyy  derivation  results  in  a  Bayes  estimator  of  the 
accuracy  measure.  The  Bayes  estimator  derived  Is  a  sufficient  statistic 
[8,  p.  1593  which  means  that  no  more  information  relative  to  the  estimate 
can  be  garnered  from  the  data  £8,  p.  155].  The  use  of  Bayes  procedures 
also  allows  probability  statements  to  be  made  about  the  parameter  (p.) 
of  Interest. 

The  numerical  analysis  (section  IV)  shows  that  the  proposed 
methodology  Is  the  most  exact  of  the  several  techniques  compared. 

3.  Minimal  Testing 

The  numerical  analysis  (section  IV)  shows  that  an  average  error 
In  n^  of  approximately  three  sorties  per  target  destroyed  can  be  achieved 
with  100  data  points.  For  r^  values  In  excess  of  40  feet,  the  corresponding 
error  Is  less  than  two.  The  100  Impacts  Is  less  than  that  required  to 
achieve  conparable  exactness  with  the  other  techniques  evaluated. 

4.  Distribution  Free 

The  multinomial  density  permits  the  data  to  define  its  own  distri¬ 
butional  shape  as  shown  in  Appendix  A. 

5.  Independent  of  Delivery  Parameters 

The  Independence  from  delivery  conditions  was  discussed  in 
section  II. D. 


Hhe  reason  for  shifting  to  n  vice  1/n  is  explained  In  section  TV. 


31 


6.  Tractlbnitv  and  Simplicity 

The  use  of  a  conjugate  family  simplifies  the  data  analysis  as 
shown  In  Appendix  B.  The  weaponeering  can  be  accomplished  from  one 
table  and  one  graph  as  shown  In  Appendix  D.  As  the  number  of  data  points 
Incrrasp-,  the  Influence  of  the  prior  decreases.  Thus,  operational  units 
»di1ch  usually  collect  extensive  data,  need  only  maintain  the  total  number 
of  Impacts  In  each  of  the  appropriate  Intervals. 

7.  Adaptibllltv 

The  adaptability  Is  highly  dependent  on  the  nature  of  I je 
adaption  required.  No  quantitative  assessment  of  the  adaptability  can 
be  made  without  knowing  the  specific  adaptation  required. 


IV.  NUMERICAL  ANALYSIS 


Numerical  analysis  was  used  to  compare  the  proposed  method  with 
other  historical  techniques.  The  Center  for  Naval  Analysis  graciously 
provided  extensive  A*7E  weapons  delivery  data.  There  were  1244  Impacts 
delivered  from  system  dive  maneuvers  with  reasonable  release  conditions. 
“These  data- were  used-to-make  a -comparison  with -real -worTd-data.  Simu¬ 
lation  data  was  used  to  make  comparisons  based  on  various  known 
distributions  with  known  parameters.  A  sensitivity  analysis  of  the  CEP 
value  used  for  the  prior  was  also  conducted. 

The  quantity  used  for  comparison  was  the  Inverse  of  the  accuracy 
measure  proposed.  The  magnitude  of  the  actual  minus  predicted  1/n  would 

A  A 

be  Inversely  related  to  the  magnitude  of  n  (  1/nnln-nl  )  and  would  lose 
meaning  If  n  were  not  presented.  In  the  Interests  of  security,  the 

A 

value  of  n  will  not  be  presented.  So,  A  =  jn-nj  is  the  parameter 
compared.  (This  term,  a.  Is  referred  to  as  the  comparator  In  the  figures.) 

A.  A-7E  DATA 

The  accuracy  parameters  derived  from  the  A-7E  data  are  not  given,  again. 
In  the  interests  of  security. 

The  true  distribution  of  impacts  was  assumed  to  be  that  defined  by  the 
data.  The  large  number  of  Impacts  (1244)  lend  credibility  to  this 
assumption.  The  n  used  in  computing  a  was  derived  from  the  percent  of 
observed  impacts  within  the  appropriate  r^  value. 

The  techniques  compared  to  the  proposed  methodology  were  basec'.  on 
thfc  coinmonly  used  circular  normal  distribution  and  on  the  recently  proposed 
Cauchy  distribution  (see  section  I.C.l.b).  Both  the  regular  distributions 
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and  the  distribution  plus  a  percentage  of  direct  hits  were  used^r  The: 
percent  of  direct  hits  was  that  observed  In  the  data.  The  pa^amters 
necessary  for  the  con^arlson  distributions  were  derived  from  the  observed 
data  using  the  estimators  shown  In  Section  I.C.I.a  and  I.C.I.b. 

A  sample  size  of  100  randomly  selected  data  points  was  chosen  as 
being  representative  of  a  small  ntonber  of  observations  for  most  .purposes , 
yet,  a  readily  achievable  number  In  a  test  environment.  Fifty  runs  of 
100  Impacts  each  were  conducted  sequentially  so  that  a  total  of  5000 
random  data  points  were  drawn  from  the  1244  .Impacts  available.  As  a  test 
of  the  randomness  of  the  samples,  the  mean  radial  error  for  each  of  the 
50  runs  were  conqiared  and  no  two  were  found  equal  when  rounded  to  the 
nearest  Integer  value. 

The  comparisons  were  conducted  for  r^  values  of  30  through  80  feet  In 
10  foot  Increments.  The  Interval  length  (w)  chosen  for  the  multinomial 
sampling  distribution  was  10  feet.  The  o  (probability  of  target  destruc¬ 
tion)  was  chosen  to  be  0.95.  The  CEP  chosen  for  the  Bayes  prior  was  of'  a 
nominal  value  and  was  over  15  feet  different  from  the  value  observed  in 
the  1244  Impacts. 

Figure  5  presents  a  plot  of  l  versus  r^  for  the  different  measurement 
methodologies.  Qualitatively,  the  circular  normal  yields  the  worst  a 
values  and  the  Bayesian  method  the  best.  The  Bayesian  method  completely 
dominates  for  r^  values  of  50  feet  and  greater.  All  the  estimates  approach 
a  common  value  at  r^  =  70  feet.  An  Interesting  point  Is  that  the  Cauchy 
distribution  appears  to  be  a  better  estimator  than  the  Cauchy  plus  direct 
hits  distribution. 

The  average  a  values  for  r^  values  equal  to  and  greater  than  30  feet 
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1..  Normal  plus  direct 

2.  Baiyeslan 

3.  Cauchy 

4.  Cauchy  plus  direct 

5.  Normal 


The  slight  advantage  of  the  normal  plus  direct  distribution  results  from 
^  -  Jhe ' large'^dif f erence '^a t- ’=-30 'feet .  ‘It* can  ‘be-  concl uded-that -the  exact 
knowledge  of  the  percent  of  direct  hits  was  of  considerable  aid  to  tiie 
rormal  plus  direct  distribution.  This  Is  substantiated  by  the  fact  that 
the  A  value  for  the  normal  plus  direct  Is  smaller  at  r^  =  20  feet  than 
at  r^  =  30  feet.  Removing  the  r^  value  of  30  feet  results  In  both  the 
Bayesian  and  Cauchy  moving  ahead  of  the  normal  plus  direct. 

Though  not  presented  In  figure  5,  several  other  techniques  for  calcu¬ 
lating  the  multinomial  parameters  (p.)  were  compared  to  the  Bayesian. 

The  maximum  likelihood  estimator  of  p.  =  /  N  and  several  weighted 

averages  of  three  and  five  adjacent  Intervals  (I.e., 

-  *1-2  **1-2  *  **1-1  '’i-1  ^  *1  Pj  "W  ’’H-l  *  **1+2  '*1.2  , 

Pi  -  w,..2  t  +  w,  +  ' 

yielded  a  values  significantly  greater  than  those  resulting  from  the 
Bayesian  technique, 

B.  SIMULATION 

In  order  to  test  the  Bayesian  technique  across  a  wider  set  of  possible 
Impact  distributions,  the  desired  distributions  were  simulated.  The 
programs  used  to  generate  the  distributions  were  those  presented  In 
Ref.  10  except  for  the  Cauchy,  The  Cauchy  was  generated  by  solving 
equation  (5)  for  r  while  using  a  random  number  generator  to  assign  values 


betneai  0  and  1  1»  F{r}.  A  df  of  >SI  end  Itirs  lar^git  3i^ 

were  used  in  tlie  ^leratita  cf  psists.  Hie  siaiwgt^ 

were  the  resular  and  ^  re^lar  piss  bit  ^  tSbe 

ciroilar  ncrml ,  droilar  ^iKigr  an!  igifetai  »S  a  ^  itm 

circular  nonal  distributions.  dxlsav  gaislsted  sf  30  leri^aat 
CEP  =  6U  feet  and  70  perofft  wlt^  C£?  ==  ^  f^t.  He  sirsfotiim 
routines  were  imified  by  plotting  a:^  ly  tae^arlns  tbe  gES«fat£j 
statistics  to  the  ir^ut  vali^. 

The  same  tedaiqu^  leere  for  csa^acrl^s  ^  idtb  tbe 
(section  IV.A).  The  forest  of  direct  bits  nes  atssfgaec  the  taem  mSm 
of  three  percent.  The  r^  va1i«  ebesea  »es  ^  feet  and  tbe  giriar 
was  CEP  =  150  feet.  One  baa^^  nos  sf  ICO  sai^es  ssb  were 

Fi^re  6  pr^oits  tie  a  valae  for  atb  of  tbe  taeliElyes  and  os 
tte  siasulated  distributic»is.  The  Saysslan  tedhnf^  prmvilea  ^Set 
estiaator  for  the  ejqxaiestial ,  saifonii  and  mfssS  atarml  dsstras.c-'nes- 
Surprisingly,  the  Bay^ian  tetbsiastt  aisc  prorid^  tbe  best  ests'igs^  ^ 
the  Cauchy  plus  direct  hit  distribatfon  iat  ly  £  i^sy  ssTI  aer^t;. 

Table  I  presents  the  sane  resslts  is  tarns  stf  t^  3«rifc^  vrf  mm 
technique  for  each  distribaticjn.  'Hs  Sa^slas  «es  test  sv^all. 

To  ensure  that  the  t^  mt  bla:^  tbe  mf  tim 
and  uniform  distrlbuticns,  tb^  were  renei^i.  Ti&ia  I 
these  results  and  the  Say^ian  t^bnique  is  still  ^sr.  ts  Sm  tie 
Interestingly,  both  the  Caseby  pris  direit  I9e 

plus  direct  when  tie  ejqssential  and  onilorBi  distr^tftiws  are  a^sssms&. 

It  can  be  omclsded  tiat  the  Bayesian  t^bnlqiK  the 

exact  ^tiaati^  of  the  tecinnques  tested  a  wite  fpgw^Mly 

l3^}act  distrilxjticns. 
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Comporotor  Volues  for  Simulation  Data. 
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C.  SENSITIVITY 

The  A-7E  data  wa.  used  to  test  the  sensitivity  of  tH  CEP  value  used 
for  the  Bayesian  prior.  As  before,  50  runs  of  100  samples  each  were 
conducted.  The  r^  value  used  was  50  feet.  CEP  values  from  120  to  180 
feet  in  increments  of  10  feet  were  tested. 

Figure  7  presents  the  a  values  versus  the  CEP  values.  The  A  values 
range  from  2.1  to  3.1.  The  minimum  a  value  does  not  occur  at  the  true 
CEP.  The  A  values  at  r^  =  50  feet,  for  three  of  the  other  techniques 
are  presented  for  conparison. 

It  can  be  concluded  that  the  Bayesian  technique  is  relatively  insensi¬ 
tive  to  the  prior  CEP  value  chosen  when  100  data  points  are  available,  and 
the  prior  CEP  value  is  reasonably  close  to  the  true  CEP  value. 


V.  COST-EFFECTIVENESS  GUARANTEE 


The  purpose  of  this  section  is  to  attempt  to  employ  the  methodology 
of  cost-effectiveness  analysis  in  specifying  and  evaluating  a  contract 
guarantee  for  an  A/G  delivery  system.  Cost-effectiveness  analysis  has 
been  defined  as  "a  method  for  studying  how  to  make  the  best  of  several 
choices.  Cost-effectiveness  is  always  used  in  relation  to  the  effective¬ 
ness  of  alternative  systems,  organizations  or  activities."  [11,  p.  Ij  It 
is  apparent  that  comparison  of  alternatives  is  the  core  of  cost- 
effectiveness  as  applied  to  choice  theory.  If  its  techniques  are  applied 
to  a  single  system,  caution  must  be  exercised. 

It  can  be  seen  from  section  I.B.l  that  present  specifications  some¬ 
times  guarantee  accuracy  in  a  restrictive  sense  which  inhibits  both  the 
guarantee  and  the  evaluation  to  determine  specification  compliance.  It 
is  also  notable  that  most  guarantees  avoid  the  issue  of  costs  except  for 
penalty  values. 

The  cost-effectiveness  approach  has  proven  valuable  in  the  choice  of 
a  system  from  a  set  of  alternatives  and  could  prove  valuable  in  guarantee¬ 
ing  a  particular  system.  Additionally,  the  cost-effectiveness  based 
guarantee  provides  a  stepping-stone  toward  controlling  cost  overruns. 

The  HOE  (l/n)  required  in  a  cost-effectiveness  analysis  has  been 
presented  in  section  II. B. 

A.  COSTS 

1.  Types  of  Cost 

The  three  types  of  total  or  life  cycle  costs  are  research  and 
development  (R&D),  investment  and  operating  costs.  To  fully  account  for 
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the  "cost"  of  a  system,  these  must  be  expressed  as  "economic  costs"  or 
benefits  lost  (ice  to  lue  use  of  the  resources  required  to  develop,  procure 
and  operate  a  particular  system.  Thus,  these  costs  Include  hardware, 
manpower,  new  i'acllltles,  supplies,  dollar,  etc.;  everyUilng  directly 
related  to  the  decision  to  achieve  the  system  [12,  p.  25,66-67]. 

Care  must  be  taken  when  costing  an  A/G  delivery  syst«n  that  Is 
to  be  Installed  In  an  airframe  so  that  the  costs  do  not  Include  those  that 
are  Incurred  by  the  airframe  Independent  of  the  A/6  system  [13,  p.  5]. 

Also  the  concept  of  sunk  costs  [12,  p.  33]  must  be  considered  If  some  of 
the  components  of  the  system  are  currently  developed  or  procurtid.  These 
costs  should  not  be  Included. 

Another  cost  that  Is  sometimes  erroneously  Included  In  computing 
system  costs  Is  the  attrition  of  systems  due  to  combat  or  operational  type 
losses.  Once  the  system  Is  developed  and  procur  id,  the  only  pertinent 
cost  is  the  operating  cost. 

The  cost  of  the  weapons  expended  to  achieve  the  MOE  are  not 
Included  due  to  their  negligible  effect  compared  to  the  other  costs.  The 
MOE  qualitatively  reflects  the  increased  weapons  cost  of  an  Inefficient 
system. 

The  methods  of  measuring  the  costs  are  well  detailed  by  Fisher 
[12]  and  many  other  authors  and  need  not  be  repeated  here.  However,  the 
total  cost  concept  has  serious  connotations  in  regard  to  a  guarantee  that 
will  be  fair  for  many  different  systems  and  needs  to  be  further  discussed. 

2.  Total  Cost 

Total  costs  represent  the  total  resource  Impact  or  full  economic 
cost  of  the  Systran,  Necessarily,  the  magnitude  of  these  costs  is  highly 
dependent  on  the  number  of  systems  purchased  and  the  operating  lifetime 


of  the  system.  (The  buy  size  and  lifetime  are  normally  estimated  during 
the  conceptual  phase  of  a  system  and  the  determination  of  these  values  Is 
not  essential  to  this  thesis.)  If  these  total  costs  are  used  to  determine 
a  cost-effectiveness  guarantee,  systems  with  a  large  buy  and/or  a  long 
lifetime  will  be  unfairly  penalized  by  the  requiranent  for  a  higher 
effectiveness  level  than  a  similar  (in  performance)  system  of  which  only 
a  few  are  purchased  and  have  a  shorter  lifetime.  Ihe  logical  conclusion 
Is  that  some  form  of  normalization  is  In  order. 

Varying  opinions  exist  as  to  whether  or  not  costs  should  be 
normalized  [6,  p.  40  and  11,  p.  293.  In  general,  normalization  tends  to 
hide  what  the  total  cost  is  and  In  the  usual  context  of  cost-effectiveness 
analysis  it  is  important  to  be  fully  aware  of  the  total  cost.  However,  in 
the  proposed  context,  the  lack  of  normalization  creates  the  Inequity  shown 
above.  Thus,  normalization  is  considered  applicable  in  the  guarantee 
context. 

3,  Cost  Model 

Close  examination  of  the  three  Incremental  costs  shows  that: 

a.  The  R&D  cost  Is  nearly  Independent  of  the  buy  size  and  system  lifetime. 
Therefore,  this  cost  can  be  used  with  no  normalization. 

b.  The  investment  cost  is  most  dependent  on  the  buy  size  and  It  seems 
natural  to  normalize  it  over  the  number  of  systems  resulting  in  units  of 
dollars  per  system. 

c.  The  operating  cost  is  dependent  on  both  lifetime  and  buy  size. 

Normalizing  over  both  yields  units  of  dollars  per  unit  of  time  per  system. 

This  win  be  expressed  as  an  annual  operating  cost  per  system  in  this  thesis. 

Now,  there  are  three  different  costs  with  three  different  dimen- 

2  4 

slons.  The  cost-effectiveness  model  has  been  transformed  from  E  to  E 
(where  e”  is  Euclidean  n-dimensional  space). 


44 


The  normalization  of  the  costs  In  the  cost  model  Is  unique  to 
the  guarantee  context  and  these  costs  should  be  used  with  care  in  other 
contexts. 


B.  COST-EFFECTIVENESS  RELATIONSHIP 

The  various  techniques  that  could  possibly  be  used  to  determine  the 
functional  relationship  between  effectiveness  and  cost  are  detailed  In 
many  sources  such  as  Theil  [14]  and  Raiffa  and  Schlalfer  [17].  Prior  to 
the  use  of  any  of  these  techniques,  however,  a  data  base  is  required. 

1.  Data  Base 

A  proper,  though  not  extensive,  data  base  exists  for  determining 
the  functional  relationship.  The  cost  data,  reliability  data,  and  weapon 
delivery  accuracy  data  for  present  and  past  systans  Is  historical  and  can 
be  used  [15,  p,  11-13]. • 

The  data  available  needs  to  be  transformed  Into  a  form  compatible 
with  the  cost-effectiveness  framework  outlined  above.  The  availability, 
dependability  (based  on  a  standard  mission  time)  and  capability  are  used 
to  compute  1/n,  The  cost  data  needs  to  bf  partitioned  in  the  appropriate 
accounts;  i.e.,  R&D,  investment  per  system,  and  annual  operating  per 
system.  Other  adjustments  to  the  data  may  be  necessary.  Examples  of 
these  are  well  detailed  in  a  RAND  report  [15,  p.  17-32]. 

2.  Technological  Dynamics 

With  the  data  transformed  Into  the  proper  framework,  two  other 
aspects  requiring  attention  still  exist.  First,  is  the  fact  that  the 
technology  under  which  each  of  the  systems  was  produced  may  not  be  the 
same.  The  natural  assumption  is  that  the  technology  is  increasing 
chronologically  and  that  later  systems  are  more  effective.  Increased 
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technology  has  historically  carried  an  Increased  price  tag.  This  Is 
partially  what  the  cost-effectiveness  curve  Is  representing.  Heaver, 
the  possibility  of  cost  decreasing,  technological  break-throughs  Is  real. 
If  during  the  determination  of  the  functional  relationship,  one  or  more 
data  points  appear  not  to  fit  the  others  then  these  must  be  studied 
carefully  to  see  If  such  a  break-through  did  exist.  When  this  Is  the 
case,  a  new  cost-effectiveness  frontier  should  be  generated  based  on  the 
new  technology.  Generally,  omitting  the  data  points  representative  of 
the  old  technology  will  be  sufficient.  It  may  be  though,  that  there  are 
too  few  data  points  from  the  new  technology.  In  this  case,  the  shape  of 
the  frontier  could  be  determined  using  the  old  technology  and  the 
"height"  (In  an  sense)  from  the  new  technology. 

3.  Inflation 

The  second  aspect  Is  that  the  dollar  used  to  cost  a  particular 
system  Is  not  the  same  dollar  used  to  cost  chronologically  future  or  prl^'r 
systems.  This  Is  not  serious  though  as  well  developed  techniques  exist 
[15,  p.  23-32]  to  account  for  the  time  dependent  value  of  the  dollar.  All 
that  needs  to  be  done  Is  to  select  a  date  for  the  base  value  of  the  dollar 
and  transform  all  dollar  values  to  this  base  date.  It  may  be  desirable 
to  change  the  base  date  periodically  to  keep  it  fairly  close  to  the 
present. 

4.  Functional  Relationship  Model 

The  statistical  technique  used  to  determine  the  functional 
relationship  between  cost  and  effectiveness  needs  to  Include  the  ability 
to  explicitly  state  the  uncertainty  incurred  in  the  predicted  form.  A 
Bayesian  regression  technique  might  be  reasonable,  due  to  the  ability  to 
make  probability  statements  concerning  the  estimated  parameters  but  no 
extensive  study  of  this  has  been  conducted  by  the  author. 
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The  successful  con^letion  of  the  above  steps  will  result  in 
the  depiction  (mathematically)  of  a  hypersurface  in  that  represents 
a  cost-effectiveness  frontier. 

5.  Uncertainty  Considerations 

When  estimating  a  hypersurface  of  unknown  form  from  a  few  data 
■points,  there  is  a  high  degree  of  uncertainty.  Though  it  would  be 
appealing  to  use  the  generated  hypersurface  for  the  guarantee,  it  might 
be  unfair.  Thus,  the  prediction  uncertainty  is  required.  The  direction 
of  the  prediction  error  is  also  uncertain  and  in  fairness  the  applicable 
lower  bound  of  the  prediction  error  interval  should  be 

C.  GUARANTEE 

4 

The  cost-effectiveness  guarantee  is  in  E  and  cannot  be  depicted 
graphically.  However,  an  interpretation  of  the  concept  can  be  portrayed 
using  a  representative  cost  axis  as  shown  in  Figure  8. 

Adding  a  minimum  effectiveness  and  maximum  cost  to  the  guarantee 
defines  the  areas  as  shown  in  Figure  8  including  the  feasible  region. 

The  minimum  effectiveness  requirement  is  straight  forward  but  the  maximum 
cost  has  hidden  implications.  In  order  to  guarantee  a  maximum  total  cost, 
that  total  cost  must  be  apportioned  among  the  modified  incremental  costs. 
Thus,  though  specifying  a  maximum  total  cost  is  preferable,  it  may  be 
difficult.  The  alternative  is  to  specify  maximum  incremental  costs 
where  the  sum  is  not  the  desired  maximum  total  cost. 

The  guarantee  also  must  specify  the  mission  time  from  takeoff  to 
on  target  and  the  r^  value.  If  these  values  are  altered,  the  entire  cost- 
effectiveness  frontier  must  be  regenerated.  Therefore,  these  values  ircist 
be  chosen  wisely. 
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Typical  Cost-Effectiveness  Guarantee. 


It  Penalty  Assessment 

The  historical  method  of  assessing  penalties  is  to  assign  a  dollar 
penalty  for  each  incremental  unit  outside  the  guaranteed  value.  In  theory 
this  penalty  assessment  seems  acceptable  but  in  practice  it  often  happens 
that  the  penalty  costs «  when  assessed,  are  charged  back  to  the  procuring 
agency  disguised  as  increased  overhead,  ground  support  equipment  or  other 
-type. costs  adding  to  the  total  system  cost.  The  theory  of  a  cost- 
effectiveness  guarantee  would  eliminate  this  practice  but  the  method  of 
penalty  assessment  could  also  eliminate  it.  The  manufacturer  could  be 
required  to  meet  the  guarantee  by  reducing  cost  or  increasing  effectiveness. 

2,  Guarantee  Currency 

A  periodic  review  of  the  guarantee  would  be  necessary  to  keep  it 
current.  A  logical  mechanism  for  ensuring  that  the  review  is  accomplished 
would  be  to  require  a  regeneration  of  the  cost-effectiveness  hypersurface 

« 

each  time  new  actual  data  becomes  availabV  '  require  a  constructive 

review  each  time  the  guarantee  is  used.  1  imum  effectiveness  and 
maximum  cost  portion  of  the  guarantee  could  be  unique  to  each  system  and 
these  parameters  could  be  defined  during  the  latter  type  review. 

3.  Guarantee  Parameters 

The  parameters  for  the  cost-effectiveness  guarantee  are  summarized 
as; 

a.  Minimum  effectiveness 

b.  Maximum  cost  of 

1)  R&D 

2)  investment  per  system 

3)  annual  operating  per  system 

c.  Cost-effectiveness  hypersurface 

d.  Penalty  assessment 


e.  Mission  time  from  launch  to  target 
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SEiiivAnQi  USE 


The  detailed  derivation  cf  estla^sss,  sm 


tedinlques,  is  present  below. 


A.  FUWTI(9I 

The  co}%xpt  of  a  Sadias  est^tor  is  imaiirizgtiap  ^  ^ 
loss;  tiHis,  a  loss  fisKtioo  Is  ee^^. 

A  loss  functiiH)  is  a  i^ctfos  that  ^sips  a  mmtsr  {ssilM  ism 
to  eadi  ccc^ifatiffii  of  decision  aaid  stats  ef  aatjBS  ^  *^3  in  tSte 
problen  at  hand,  the  state  of  Kg  tyre  is  ISm  taesrstlc  aaiiaer  33 
destroyed  per  sortie  (l/n).  The  ^isica  is  the  25 

ized  as  l/n.  Aigr  waaffi^tivs  fiaatioa  of  the  &rm  am  Sie 

used  as  a  loss  ionctica  for  estiisatio®  £S,  p,  lae  cawssaly 

used  are  absolute  valis  of  tie  disferesoe  ais  spares  grro! 

O^root  shows  £8,  p,  227-22B3  tiat  tie  padratie  liss  fe  am  a^^ss^we 
^proxication  for  a  vli^  of  nonne^ti^e  io^  fimztaots^ 

because  of  ^is,  the  pedratfc  irss  chc^m.  An  iscSSoiX 
involved  In  this  choice  is  that  t^  disftility  an  » 

id^tlcal  to  that  of  an  aodaestiiate. 

The  loss  function  Is 

(A.l)  L  =  a  CV®  -  l/c)  »*ej«  a  is  seme  annn^ptSa* 

Itecalling  equation  (15)  (Srtsi!  sectfas  iIX|  with  1  =  1  ,  tSe  can  4e 
ejqir^sed  as: 

— 2I — T  ”  laD-sl3~  whsie  s  3s  she  a^-Sa^nr  rf  ^ 

la  O-c:} 


(A.2)  L  = 


Lettii^  the  decision  be  0  =  In(l-p)  and  the  state  of  nature  be 
3  =  In(l-p),  L  =  K(D-e)^  **ere  K  =  a/ln^O-o).  DeGroOt  shows  [3,  p.  2283 
that,  for  this  loss  function,  the  Bayes  decision  against  any  .given  d1str1> 
butlon  of  6  Is: 

(A.3)  D*  =  E£e3 


B.  S/miHS  DISTRIBUTION 

One  of  the  attributes  listed  In  section  I.D  was  that  the  methodology 
be  distribution  free.  The  use  of  a  multinomial  distribution  to  depict 
the  Impact  pattern  achieves  this  goal.  The  form  of  the  multlncmilal 
probability  mass  function: 


(A.4)  f CX| ,. . . jXi^INiPi , . ,p  ) 


k 

where  l  x- 
1=1  ’ 

k 


N 

1 


Pj  ^  0  1=l,,..,k 


permits  the  cismilatlve  distribution  curve  to  take  nearly  any  shape  fnwi 
convex  to  concave  and  many  conblnatlons  thereof. 

Due  to  the  desirable  Independence  from  run-in  heading  shewn  In  section 
II. E,  the  radial  miss  distance  was  chosen  as  the  variable  for  the  density. 

Figure  A.l  relates  the  geometry  of  the  Impact  pattern  to  the  multi¬ 
nomial  density.  The  p-  are  tte  probability  of  an  Impact  In  the  1^ 
Interval  and  the  x-  are  the  nunber  of  Injects  In  the  l^*’  Interval. 
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No.  of  impacts  ( x  =  p,  n  / 


i 

[ 


Target 


t 


Figure  A.l 

Relationship  of  Multinomial  Density  vo  Target  Geometry. 
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The  length  of  the  intervals  (w)  can  be  assigned  as  desirable.  They 
need  not  be  of  uniform  length*  though  it  is  assumed  here  that  all  but 
the  will  be.  The  interval  will  include  the  portion  of  the  real 
line  beyond  the  end  of  the  (k-1)^^  interval.  It  would  seem  logical  to 
choose  an  interval  length  that  is  some  function  of  the  measurement 
accuracy  of  the  data  collection  method.  A  reasonable  choice  seems  to  be 
an  interval  length  equal  to  twice  the  measurement  error  in  the  data 
collection.  The  data  analyzed  for  this  thesis  was  collected  with  a 
measurement  error  of  t5  feet  leading  to  w  =  10  feet. 

Another  consideration  is  the  number  of  intervals  (k).  The  choice  of 
k  should  be  based  on  the  number  of  data  points  available  for  analysis, 
the  Interval  length  and  the  maximal  miss  distance  of  interest.  The  observed 
distribution  of  impacts  may  also  Influence  the  choices  of  k  and  w.  In 
general,  a  study  of  the  system,  observed  data,  and  data  collection  method 
should  enable  one  to  assign  reasonable  values  to  k  and  w. 
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C.  CONJUGATE  FAMILY 


The  use  of  a  conjugate  family  in  Bayesian  analysis  simplifies  the 
mathematical  manipulation  and  ensures  an  estimate  based  on  a  sufficient 
statistic  [8,  p.  159]. 

The  conjugate  family  for  the  multinomial  is  the  multivariate  Beta 
or  Dirichlet  distribution  [8,  p.  174].  The  functional  form  of  the 
Oirichlet  density  Is; 


(A.  5) 


^Cp^ » •  •  •  »Pj^  I  O'! , . . .  >Q|^) 


where 


Pi 


=  1 


>  0 


a.  >  0 


r(a^)  (cj^) 


1**!  >  •  •  • 


^  . . . . . 


The  expected  value  and  'Mrlance  are: 


{A.6) 

EIP^]  = 

®i 

— —  where  o 

“o 

(A.7) 

V[?,]  = 

DeGroot  shows  [8,  p.  174]  that  if  the  prior  parameters  are 
and  are  the  ntimber  of  observations  in  each  interval,  then  the 

posterior  parameters  are  a^+x^... ,aj^+X|^. 

D.  ESTIMATORS 

It  was  stated  in  paragraph  A  (Loss  Function)  that  the  Bayes  estimator, 
D*,  was  equal  to  the  expected  value  of  9  =  In(l-p).  There  is  an  obvious 
difference  between  the  distribution  of  e  and  the  posterior  distribution 
of  the  vector  of  p^‘s.  One  assumption  and  one  approximation  are  used  to 
derive  the  Bayes  estimators  for  the  p^-'s. 

The  assumption  involves  the  relation  p  =  A^DC.  C  is  the  probability 
of  an  Inpact  within  r^  of  the  target  given  some  state  of  the  system. 

Thus,  C  is  related  to  the  posterior  of  the  p^'s  by; 

m 

(A.8)  C  =  I  Pj  where  m  is  the  smallest  integer  satisfying  the 
i=l  * 

inequality  m  ^  r^/w 

m  m  m  oj  +  Xj 

Note  that  ECC]  =  EC  E  p.]  =  z  E[p.]  =  z  — = - -  . 

i=1  ^  i=l  ^  1=1  “o 

Assuming  the  reliability  of  the  system  is  unity  (A^D  =  1)  permits  setting 
E[p3  =  EEC], 


£5 


The  approximation  involves  the  relation  e  =  In(l-p).  For  reasonable 
values  of  r  ,  the  values  of  p  are  relatively  small  (less  than  .2).  For 
such  values  of  p,  In(l-p)  can  be  approximated  by  p  with  a  maximum  error 
of  approximately  15  percent. 

The  approximation  c  =  In(l-p)  permits  setting  D*  =  £[0]  =  ECp]  =  £[€]. 
Thus 3  the  Bayes  estimators  for  the  are; 

(A.9)  p.*  =  '  ^  '  and 


(A.IO) 


5*  = 


m 

z 

i=l 


“i 


E'.  PRIOR  PARAMETERS 

For  the  subject  problem  several  schemes  for  assigning  the  prior 
parameters  were  possible.  The  pnme  factor  dictating  tne  choice  was  to 
require  a  minimal  number  of  parameter  values  to  be  assigned. 

One  of  the  most  widely  used  and  weil  known  accuracy  parameters  is  the 
CEP.  The  CEP  is  also  one  of  the  easiest  parameters  to  assign  a  priori. 

The  assignment  can  be  based  on  system  simulation,  system  design  or  some 
other  method  tempered  by  experience.  The  procedure  for  using  CEP  as  a 
single  assignment  parameter,  as  discussed  below,  is  Ad  Hoc.  Several 
assumptions  are  made,  the  justification  of  which  is  made  in  section  III.B. 
Jn  terms  of  the  p^'s,  the  CEP  is  defined  as; 

J 

.5  =  z  p,.  where  j  =  CEP/w. 
i=l  ’ 

Assuming  E[pJ  are  equal  for  i  =  l,,..,j  and  a  uniform  length  (w}  for 
intervals  l,,..,j; 


56 


i  5 


E[p^3  =  .5/j  ;  i  = 

and  from  equation  (A. 6),  the  o.  are  equal  for  i  =  Allowing  the 

interval  to  be  the  remainder  of  the  distribution,  E[Pjj]  =  *5. 

From  et  'iation  (A. 6)  and  the  discussion  aLOve, 

3 

‘o  ^  “i  “k  ^“i  “k 
i~ « 

and  E£p,]  =  - ^ - 

ja,  + 

thus, 

t  Oj^)  i  ~  l,...,j 

and 

=  .5  t.jo^  +  aj^) 

These  equations  are  >olved  to  find 

aj^  =  ja.-  i=l,...,j  as  might  have  been  expected. 

Attempting  to  u:e  the  derived  values  and  assigning  values  to  the 
variances  (equation  (A. 7))  leads  to  an  inconsistent  systen  of  equations. 
This  can  be  resclvea  by  assuming  that  each  p.  is  distributed  syinnetrically 
about  its  expected  vaiua.  Then  the  variance  of  the  p.  for  i=l,...,j  can 
be  set  such  that  95  percent  of  the  probable  p-  will  be  nonnegative.  It 
follows  that: 

V[pp  =  tE[Pj]/1.64)^ 

For  i=l,..,,j; 

V[p-]  =  (1/3.28j)2 
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APPENDIX  B 
SAMPLE  DERIVATION  OF 


The  procedures  for  using  the  Bayesian  technique  suggested  in  this 
thesis  are  illustrated  by  a  simple,  fictitious  example  involving  a  sample 
of  10  impacts.  Suppose  the  observed  radial  miss  distances  (in  feet)  for 
dive  maneuvers  in  the  prime  mode  are: 

7,  92.  56,  37,  23,  6,  88,  75,  29,  41- 

An  interval  length  of  10  feet  and  prior  CEP  of  50  feet  will  be  used. 

j  =  CEP/w  =  50/10  =  5  thus  k  =  6 


ag  =  12.61 


The  values  of  interest  can  be  tabulated  as  follows: 


i 

interval 

endpoints 

!i 

X  * 

^i 

“i  ■"*1 

Pi** 

1 

0-10 

2,52 

2 

4.52 

.13 

2 

10-20 

2.52 

0 

2.52 

.07 

3 

20-30 

2.52 

2 

4.52 

.13 

4 

30-40 

2,52 

1 

3.52 

.10 

S 

40-50 

2,52 

1 

3.52 

.10 

6 

50-<» 

12,61 

4 

16.61 

.47 

*.x.  is  the  number  of  impacts  observed  in  the  1^  interval. 
J  a-  +  X,  6 


«  a-  +  X. 

=  J — 1 
“o 


;  a  =  X  +  X.)  . 
”  1=1  ' 
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APPENDIX  C 

EXAMPLE  DERIVATION  OF  p 

The  equation  p  =  A^DC  given  In  the  WSEIAC  report  [7]  Is  e:xpla1ned 
by  the  following  fictitious  example  using  the  C  vector  component  as 
derived  In  /^pendlx  B. 

Consider  a  system  which  has  a  prime  mode  and  one  degraded  mode.  The 
possible  system  states  are  defined  as: 

A  <1-  prime  mode 
B  -  degraded  mode 
C  -  Inoperative 

Suppose  the  availabilities  (probability  that  the  system  Is  In  some 
state  at  the  beginning  of  the  mission)  are: 

P{A}  -  1/2 

P{B}  =  1/4 

P{C}  =  1/4 

Thus,  A^  =  Cl/2,1/4,1/4). 

Assume  the  system  cannot  be  repaired  In  flight.  The  dependabilities 
(probability  that  the  system  is  in  some  state  at  a  specified  time  after 
takeoff  given  the  system  state  at  the  beginning  of  the  mission)  are 
assumed  to  be: 

Given  state  A  at  the  beginning  of  the  mission; 

P{A}  =  1/2 

P{B}  =  1/4 

P{C}  =  1/4 

Given  state  B  at  the  beginning  of  the  mission; 


60 


P{A}  *  0 
P{B}  =  3/4 
P{C}  =  1/4 

Given  state  C  at  the  beginning  of  the  mission; 

P{A}  =  F{B}  =  0 
P{C}  =  1 

Thus,  D  =  ’  1/2  1/4  1/4  and  A^D  :=  (.1/4,5/16,7/16) 

0  3/4  1/4 
0  0  1  ^ 

The  A^D  is  constant  for  a  constant  mission  time  and  In  most  systems 
will  probably  remain  fal^'ly  constant  over  various  mission  times.  There¬ 
fore,  in  the  weaponeering  usage  this  could  be  accepted  as  a  set  of  values 
unique  to  each  A/G  delivery  system.  Then,  only  the  final  calculation 
(shown  next)  need  be  performed  for  various  r^  values. 

The  capabilities  (probability  that  v/eapon  impacts  within  r^  of  the 
target  given  the  system  state  at  the  time  of  release)  are  as  derived  in 
Appendix  B  using  r^  =  30  feet^ ; 

3  . 

PihitlA}  =  E  P,-  =  .33  =  1/3 

1=1  ’ 

P{hit|B}  =  1/6 
P{hit|C}  =  0 

Thus,  =  (l/3,l/6,0) 

Hhe  P{hit|B}  is  assumed  to  be  1/6.  The  value  for  the  degraded  mode 
was  not  computed  in  Appendix  S. 


61 


^  T  “ 

Solving  for  p  =  A  DC 


p' 


0/4.5/16,7/16) 


T  T 

1/3 

1/6 


=  13/96 


Therefore,  the  estimated  probability  of  placing  a  weapon  within  30  feet 
of  the  target  with  this  system  Is  13/96. 
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APPENDIX  D 
WEAPONEERING  EXAMPLE 

The  weaponeering  usage  of  the  proposed  measurement  and  methodology 

A 

win  be  illustrated  using  the  fictitious  p  calculated  in  Appendices  B 
and  C. 

For  "the  computed  p-= ‘13/96 -and ‘assuming  0'=  .-95,  n  can.be  calculated 
as: 

n  =  1n(l>a)  ,  1n(.05)  ^  gl 

In(l-p)  lnC83/96) 

A  graph  similar  to  that  shown  in  Figure  D.l  could  be  used,  vice 

A  A 

solving  the  above  equation,  to  find  n.  Entering  the  graph  with  p  (called 

A 

the  cumulative  percentage)  and  a,  the  n  could  be  found. 

In  general  usage,  the  weaponeering  requirements  would  be: 

1)  Capability  tables  for  the  applicable  system  and  degradation  modes. 

T 

2)  AD  vector  for  the  applicable  system. 

3)  Graph  similar  to  Figure  D.l. 

If  the  A^D  were  negligibly  dependent  on  mission  time,  requirements  1  and 
2  could  be  combined  into  a  single  table  of  p  values  for  the  various  values 
of  rg. 

At  the  ship  or  airwing  level,  the  weaponeer  could  use  the  individual 
squadron  capability  tables  or  an  airwing  table  aggregated  over  particular 
systems  in  the  airwing,  (i.e.,  A-7  capability,  F-4  capability,  A-6 
capability).  In  mixed  strikes,  the  ship  level  weaponeer  could  use  a 

A 

ratio  weighting  factor  for  the  p  based  on  the  scheduled  mix.  As  an 

A 

example  consider  a  strike  consisting  of  8  A-?,  4  A-6  and  8  F-4.  The  p 

A  A  A  A 

vjilue  for  the  strike  could  be  p*  =  •4p^^7  +  •2py^^g  +  ^App^^. 
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Cumulative  Percentage  (C|) 
Figure  D.  I 
Weaponeering  Graph 
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